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Summary of Progress 


During the first six months of the current grant period, progress was 
made in the following areas: 

1) Undetected Error Probability and Throughput Analysis of a Concatenated 
Coding Scheme. 

A paper was submitted to the IEEE Transactions on Communications sum- 
marizing our work on the performance analysis of NASA’s telecommand sys- 
tem. A copy of this paper is included with this report. This work was 

initiated under a previous grant (NAG5-234) and completed in the current 
grant period. Our analysis assumes that the decoded frames are scrambled 
(interleaved) prior to decoding by the outer code. This assumption sim- 
plifies the analysis for the outer code and yields similar results to 
those obtained by Lin and Kasami under NASA grant NAG5-407. 

Because of the interleaving assumption, it is not necessary to know 
the detailed weight structure of the erroneously decoded frames but only 

the average decoded bit error rate. This allows us the possibility of 

evaluating many different frame Coding options. One of the most interest- 
ing was to consider a (63,56) frame code decoded using a soft decision 
Viterbi decoder with a i? = 128 state trellis. This has two advantages 
over the standard method of decoding this code (as a distance -4 Hamming 
code). First, soft decisions yield improved decoder performance over hard 
decision decoding. Second, a variable threshold can be set on the decod- 
ing trellis metrics which allow one to exchange system reliability for 
throughput. A tightened metric threshold allows only the most reliable 
frames to be decoded, resulting in very high reliability at a lower 
throughput. A looser metric threshold will improve throughput with some 
sacrifice in reliability. It is recommended that further study of this 


frame coding option be undertaken to compare its performance in detail to 
that of the standard hard decision decoding option. 

2) Capacity and Cutoff Rate Analysis of Concatenated Codes. 

A paper was submitted to the IEEE Transactions on Information Theory 
summarizing our work on analyzing the capacity and cutoff rate of the 
"outer channel" formed by the combination of the actual physical channel 
and the inner encoder and decoder in a concatenated coding system. A copy 
of this paper is included with this report. The purpose of this study is 
to determine the best combination of inner and outer codes to use in a 
concatenated coding system. The submitted paper covers the case where the 
inner code is a block code. This work, begun under a previous grant 
(NAG5-234) , has established that in general (1) it is better not to 
interleave between the inner and outer codes, and (2) for a fixed overall 
code rate, it is better to use higher rate inner codes and lower rate 
outer codes. This suggests that systems such as NASA's TDRS system could 
achieve better performance with _a higher rate (greater than 1/2) inner 
code and a lower rate outer code (with more than 32 check symbols). 'It 
also suggests that if higher rate, more bandwidth efficient codes are 
needed, the rate of the inner code, rather than the outer code, should be 
increased. Work is continuing on this problem with the case of inner 
convolutional codes being considered. The analysis is more difficult in 
this case because the inner decoder error events do not appear in blocks 
of fixed length but can be of many different lengths. In addition, two 
parameters rather than one affect the error event lengths: both the 
information block size k and the encoder memory order m. 


3) Bandwidth Efficient Codes 

There are two basic ways in which higher rates of information 
transmission can be achieved over NASA's existing uplink transmission 
facilities: 

i) Higher code rates can be used. This would mean increasing thie 
rate of the inner code from the current 1/2 or 1/3 to a rate 
closer to unity. 

ii) A larger set of modulation symbols can be used. This would 
mean expanding the current modulation system from QPSK to 
8-PSK. or 16-PSK modulation. 

The most straightforward means of achieving higher rates of informa- 
tion transmission is to increase the rate of the inner code. Recent work 
by Lin and Kasami has investigated the use of "cascaded codes" which 
increase the overall system rate from .437 to rates as high as .721 (a 
maximum 65% increase in information transmission rate). These cascaded 
codes use a combination of erasure decoding and a decoding failure mecha- 
nism to achieve very high reliability. The inner code in a cascaded code 
is a high rate shortened BCM or Hamming code, while the outer code is an 
RS code which is capable of errors-and-erasures decoding. 

We are currently investigating the use of higft rate (2/3 and 3/4) 
inner convolutional codes along with an outer RS code for this same appli- 
cation. The inner convolutional code can make use of soft decision 
Viterbi decoding to provide a performance advantage. We are working on a 
scheme for declaring erasures under certain conditions at the output of 
the Viterbi decoder, so that an outer errors-and-erasures RS decoder can 
be used. This scheme must be capable of identifying which portions of the 
Viterbi decoder output are unreliable. In this way only unreliable 



symbols In the outer code are erased. We are also Investigating the use 
of even higher rate (up to rate 8/9) unit-memory inner codes for use with 
outer RS codes. These codes have an information block size which is 
matched to the symbol size of the outer code, thus providing a natural 
coding interface. Schemes for declaring erasures of unreliable informa- 
tion blocks from the inner decoder are being developed for this case as 
well. Our goal is to achieve even higher rate schemes using inner convo- 
lutional codes than those being studied using block codes. We believe a 
performance advantage will accrue to the convolutional codes due to the 
availability of soft decision decoding, particularly when unit memory 
codes are used. Results of this investigation will be included in our 
next report. 

All of the above mentioned schemes maintain the use of QPSK modula- 
tion in which one bit of information is transmitted per signal dimension 
(a QPSK signal is simply two BPSK signals transmitted in phase quadra- 
ture). As such, the maximum possible increase in transmission efficiency 
would be a doubling (100% increase) of the information transmission rate, 
which could be achieved by using uncoded QPSK modulation instead of an 
inner code. Any cascaded coding scheme which uses OPSK modulation will 
achieve something less than a 100% increase in transmission rate. Higher 
percentage increases in rate can only be achieved by expanding the modula- 
tion set to more than four phases. 

We have done some preliminary work on combining an inner convolu- 
tional code with 8-PSK modulation. A summary of a paper presented at the 
recent Allerton Conference, along with copies of the transparencies used 
for the presentation, are included with this report. A rate-2/3 inner 


convolutional code combined with 8-PSK modulation achieves a transmission 



rate of one bit per signal dimension, the same as for uncoded QPSK. How- 
ever, the coding/modulation combination provides a coding gain over 
uncoded QPSK modulation, as has been documented in numerous recent 
articles (see, for example, [1] and [2]). Even higher transmission rates 
can be achieved. For example, if a rate-5/6 inner convolutional code' is 
combined with two 8-PSK signals, five information bits are sent in four 
dimensions. This represents a 150% increase in transmission efficiency 
over the scheme which uses a rate-1/2 inner code. Coding gains (compared 
with uncoded transmission at the same rate) can also be achieved with the 
rate- 5/6/8 -PSK scheme. Expanded modulation sets combined with convolu- 
tional coding provide the key to achieving reliable communication at 
information transmission rates which can even exceed the available channel 
bandwidth. 

In the next phase of our research we will be examining the perform- 
ance of some of these combined coding/modulation schemes concatenated with 
an outer RS code to provide even greater reliability at high rates of 
information transmission. Schemes for erasing certain inner decoder out- 
put symbols for errors-and-erasures decoding by the outer decoder will 
also be investigated. 
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Appendix 


This appendix presents a collection of performance figures for 
various uplink error control coding systems. In all the figures, the 
transmission channel is assumed to be AWGN with BPSK modulation. 

I . Performance of convolutional codes . 

Figure 1 shows simulation results for the bit error rate of 
convolutional codes of constraint Length K = (m+l)k = 7 and of rates 
R = 1/2 and R = 1/3 [1]. We also plotted simulation results for the 
bit error rate of punctured codes of rates R = 2/3, 3/4, and 7/8 [2,3]. 
The punctured codes are generated from a constraint Length K = 7 rate 
R = 1/2 convolutional code. Three bit quantization is used. 


II. Performance of RS codes. 


The bit error rate after decoding of RS codes can be estimated by 

Pb - I (^p 1 (l-p) N - i 

N.2 i=t+1 i 

where N and d are the code length and minimum distance of the RS code. 


( 1 ) 


■ m 


? and p is the channel symbol error rate. Assuming that the 
symbols of the RS code are over GF(2 8 ), then N = 2®-l = 255. For BPSK 
modulation over an AWGN channel with hard quantization, the channel bit 
error rate is 

e = Q(j2 R% , (2) 

^ Nr> 


and the channel symbol error rate p in (1) is given by 

p = 1-(1 - e) 8 . 


(3) 


Using (1 ) - (3), the bit error rate performance of RS codes with symbols 
from GF(2 8 ) is depicted in Figure 2. 



III. Performance of concatenated codes for £ Vlterbi -decoded 
convolutional inner code and £ Reed-Solomon outer code . 

We use rate 1/2 and 1/3 constraint length 7 convolutional codes and 
rate 2/3, 3/4, and 7/8 punctured convolutional codes as inner codes. The 
inner codes are decoded by the Viterbi decoding algorithm with three bit 
quantization. The outer code is an RS code with symbols over GF(2^). 

The code length is chosen to be 2^ - 1 = 255. We denote the overall code 
rate by R. 

To calculate the performance of the concatenated code, we upper bound 
the outer channel symbol error rate by 8 times the outer channel bit error 
rate [1]. Then (1) can be used to estimate the bit error rate at the 
output of the concatenated code. 

The code performance for inner code rates of 1/3, 1/2, 2/3, 3/4, and 
7/8 and t = 8, 16, and 32 RS codes is plotted in Figures 3, 4, and 5, 
respectively. 


IV. Performance of cascaded codes . 

In [4] a cascaded coding scKfeme is described. The inner code is a 
binary (ni,k^) code with minimum distance d^ . The outer code is an 
( n 2>k-2) ^ code with symbols from GF(2®). The performance of the cascaded 
code is measured by two parameters - the probability of block erasure, P es , 
and the probability of block decoding error, P er . 

If the cascaded code is used in an ARO system, then the erased block 
can be retransmitted. In this case the bit error rate at the output of the 
cascaded code decoder is given by 


?b = 



er » 


( 4 ) 


and the system throughout is given by (for selective-repeat ARQ) 

n - — “ (1-P es ) - R(l-Pes>* (5) 

n l n 2 

On the other hand, if the cascaded code is used in an FEC system, the 
bit error rate after decoding is -< K 

p b = ^ < p er +p es>- (6) 

“ 1^2 

In Table 1, we list the inner codes used in the cascaded code. 

Table 1. Inner Codes 





fl 

*r 

“Hr 

generator 

polynomial 

Ci(l) 

Shortened 

BCH 

59 

40 

8 

(1+x) (l+x+x^) 

(1+x+x 2 +x^+x 6) (l+xfx^+x^+x^) 

Cl (2) 

Shortened 

BCH 

53 

40 

6 

(1+x) (1+x+x^) 

(1+x4-x 2 +x^+x6 ) 

Cl(3) 

Shortened 

BCH 

61 

48 

6 

(l+x)(l+x+x6) (1+x+x 2 +x 4 +x6) 

C X (4) 

Shortened 


30 

24 

4 

(1+x)(1+x+x6) 



Hamming 


Figures 6-9 show the performance of the cascaded codes when used in a 
selective-repeat ARQ system. 

Figures 10-13 show the performance of the cascaded code when used in an 
FEC system. 

V. Conclusions . 

When a cascaded code is used in ARQ systems, it provides extremely low 
bit error rates, but it is only useful for large E b /N 0 (larger than 5 dB). 

If E b /N 0 < 5 dB, the system throughput becomes very small. 

If a cascaded code is used in an FEC system, high system reliability 
(low bit error rate) cannot be achieved due to erasures in the outer code. 

Comparing the results in sections III and IV, we see that the con- 
catenated code with a Viterbi decoded inner convolutional code and an RS 


outer code performs somewhat better than the cascade code. 
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Figure 1. Performance of convolutional codes of constraint 
length K=7 . Three bit quantization is used. 
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Figure 3. ' Performance of concatenated code with (255,239) RS outer 
code and Viterbi decoded inner convolutional code of 
constraint length 7 and of rate: (1) R =1/3; (2) R =1/2; 
(3) R 1 =2/3; (4) R.^3/4; (5) R^l/8. 1 1 
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Figure 4. Performance of concatenated code with (255,223) RS outer 
code and Viterbi decoded inner convolutional code of 
constraint length 7 and of rate: (1) R =1/3; (2) R =1/2; 
(3) Rj-2/3; (4) 3/4; (5) 7/8. 1 1 
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Figure 5 


Performance of concatenated code with (255,191) RS outer 
code and Viterbi decoded inner convolutional code of 
constraint length 7 and of rate: (1) R =1/3; (2) R =1/2; 
(3) R=2/3; (4) R =3/4; (5) R,=7/8. 1 1 
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Figure 11. 


Performance 

of cascaded code (FEC) . 

(1) 
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code: 

C. (2) , 

outer 

code: 

(255,228) 

RS 

code. 

E, 

Id=l, 

R=0. 675; 

(2) 

Inner 

code: 

07(2) , 

outer 

code : 

(255,228) 

RS 

code. 

L, 

Id=l, 

R=0. 675; 

(3) 

Inner 

code: 

c} (2) , 

outer 

code: 

(255,239) 

RS 

code, 

E, 

Id=5, 

R=0. 707 ; 

(4) 

Inner 

code: 

07(2), 

outer 

code: 

(255,237) 

RS 

code. 

L, 

Id=5, 

R=0. 701. 
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E: Erasure-only inner decoding; L:LIA inner decoding; 
Id: Degree of interleaving; R: overall code rate. 


Note: 





nee of cascaded code (FEC) . 
0 RS code, E, Id=l, R=0.678 
) RS code, L,. Id=l, R=0.688 
) RS code, E, , Id=6, R=0.721 
) RS code, L, Id=6, R=0.718 
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Performance of cascaded code (FEC). (1) Inner code: C, (4), outer 
code: (255,228) RS code, E, Id=3, R=0.715; (2) Inner code: 0,(4), 
outer code: (255,225) RS code, L, Id=3, R=0,706. 1 

asure-only inner decoding; L:LIA inner decoding; 

'egree of interleaving; R: overall code rate. 





